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Abstract 


We consider here the one-machine serial batching problem under 
weighted average completion. This problem is known to be NP-hard 
and no good approximation algorithms are known. Batching has wide 
application in manufacturing, decision management, and scheduling 
in information technology. 

We give an approximation algorithm with approximation ratio of 2; 
the algorithm is a priority algorithm, which batches jobs in decreasing 
order of priority. We also give a lower bound of 246 & 1.1124 on 
the approximation ratio of any priority algorithm and conjecture that 
there is a priority algorithm which matches this bound. Adaptive 
algorithm experiments are used to support the conjecture. An easier 
problem is the list version of the problem where the order of the jobs 
is given. We give a new linear time algorithm for the list batching 
problem. 
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1 Motivation and Background 


Batching problems play an important role in Information Technology. We 
consider the batching problem where a set of jobs J = {J;} with processing 
times p; > 0 and weights w; > 0, 7 = 1,...,n, must be scheduled on a 
single machine, and where / must be partitioned into batches B,,...,B,. 
All jobs in the same batch are run jointly and each job’s completion time 
is defined to be the completion time of its batch. We assume that when 
a batch is scheduled it requires a setup time s = 1. The goal is to find 
a schedule that minimizes the sum of weighted completion times \> wiCi, 
where C; denotes the completion time of J; in a given schedule®. Given a 
sequence of jobs, a batching algorithm must assign every job J; to a batch. 
More formally, a feasible solution is an assignment of each job J; to the min 
batch, ¢ € {1,...,n}. 

For example, Figure 1 shows two schedules for a 5-job problem where 
processing times are p, = 3,p2 = 1,p3 = 4,p4 = 2,p5 = 1 and the weights 
are Wy = Wa = ws = 1 and wo = w3 = 2. We note that the encircled 
values give the sum of the weighted completion times of the two depicted 
schedules. For example, the first schedule implies Co = 7,C3 = 5, and 
Ci = Cy = Cs = 14. Thus the sum of weighted completion times of the first 
schedule is 7-2+3-2+14(1+1+41) = 66. For convenience we sometimes 
write the job data in the form {(p1, w1), (p2, w2),---, (Pn, Wn)}. Thus in the 
example we would have written {(3, 1), (1,2), (4, 2), (2,1), (1, 1)}. 

The problem considered in this paper has the jobs executed sequen- 


®Note that this is equivalent to finding a schedule that minimizes average weighted 
completion time, as sum of weighted completion times is related to average weighted 
completion time by a factor of n. 
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Figure 1: A Batching Example (s-batch). 
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Figure 2: A Batching Example (p-batch). 


tially, thus the problem is more precisely referred to as the s-batch problem. 
We note that there is a different version of the problem not studied here, 
where the jobs of a batch are executed in parallel, known as the p-batch 
problem. In that case, the length of a batch is the maximum of the pro- 
cessing times of its jobs. Figure 2 gives an example of a p-batch schedule. 
Note that in the example Cy, = Co = C4 = 3, C3 = Cs = 8, and thus the 
sum of the weighted completion times is 3(1 + 1+ 2) + 8(2+ 1) = 36. We 
note that this version of the problem is solved by an O(nlogn) algorithm 
due to [7]. The s-batch problem studied here is more precisely denoted as 
the 1|s-batch| $> w;C; problem in a|G|y notation. Brucker and Albers [1] 
showed that the 1|s-batch| }> w;C; problem is ’P-hard in the strong sense 
by giving a reduction from 3-PARTITION. 

There is a large body of work on batching problems (see e.g. [2, 3, 
6, 7, 9, 12]) and batching has wide application in manufacturing (see e.g. 
[8, 16, 20]), decision management (see e.g. [14]), and scheduling in infor- 
mation technology (see e.g. [{10]). More recent work on online batching is 
related to the TCP (Transmission Control Protocol) acknowledgment prob- 
lem (see [4, 11, 13]). We also note that there are many variants of the 
problem, with many different complexity results. For a survey, see chapter 
8 of [6]. Still, the 1|s-batch| $> w;C; problem is considered fundamental in 
scheduling theory and it is indeed surprising that little is known about its 
approximability. 

Here we give an approximation algorithm for the 1|s-batch| > w,C; 
problem. In fact, we give two algorithms, one called PSEUDOBATCH, and 
the other one called CANONICALBEST. For approximation alsOrehis i is 
natural to consider the jobs according to ue order of priorities qi = a . If 
the jobs are renumbered such that a > 22 = ee ra we say that the Obs 
are in canonical order. An algorithm that schedules the jobs in this order 
is called a priority algorithm. Both of our approximation algorithms are 
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Figure 3: List Batching. 


priority algorithms. 

We recall that the quality of an approximation is measure in terms of 
its approximation ratio p: Given an optimization problem P we say that 
algorithm Ap has approximation ratio p if for every instance 7 € P, 


J cost of the solution given by Ap for instance 7 
= cost of MINIMUM for instance 7 


o) 


where MINIMUM is value of a minimum solution. We show that PSEUDO- 
BATCH and CANONICALBEST both have approximation ratio p = 2. We 
also give a lower bound of 24+v/6 & 1.1124 on the approximation ratio of 
any priority algorithm and conjecture that CANONICALBEST matches this 
bound. Adaptive algorithm experiments are used to support the conjecture. 

A much easier version of the problem is the list version of the problem 
where the order of the jobs is given, i.e., m; < mj; if < 7. For example, Fig- 
ure 3 shows three schedules for a 5-job problem {(3, 1)(1, 1)(4, 1)(2, 1)(, 1}. 
The encircled values give the sum of weighted completion times of the sched- 
ules to the left. 

Brucker and Albers [1] gave a linear time algorithm for the list batching 
problem. (Thus, to solve the 1|s-batch| }> w;C; problem, it is sufficient to 
know the order of jobs in the optimal solution.) We give an alternative al- 
gorithm in this paper. Our algorithm exploits the fact that the problem can 
be reduced to a shortest path problem, where the underlying cost matrix is 
a totally monotone matrix and thus can use the matrix searching algorithm 
of Larmore and Schieber [15] as a subroutine. A matrix A is called totally 


monotone if for all i < 7’ and j < j’, Ali,j] > Ali,7’] implies Ali’, 7] > 
Aji’, 7’); matrix A is called Monge if A[i, 3] + Ali’, 7’] < Al’, j] + Ali, 7’). 
Clearly, every Monge matrix is totally monotone. We note that the linear 
time list batching algorithm is used to implement CANONICALBEST in run 
time O(nlogn). 

Our paper is organized as follows: In Section 2 we give our priority 
approximation algorithms. Section 3 gives our alternate linear time algo- 
rithm for the list batching problem. Section 4 presents the lower bound 
on the approximation ratio of any priority algorithm. Section 5 describes 
genetic algorithm experiments. Specifically, we give an adaptive algorithm 
experiment which supports the conjecture that the approximation ratio of 
CANONICALBEST matches the lower bound. This section also contains the 
description of a genetic algorithm for the 1|s-batch| > w;C; problem im- 
plemented under GAlib, the object-oriented library of Matthew Wall [19] 
developed at the Massachusetts Institute of Technology. We conclude with 
open problems in Section 6. 


2 Approximation Algorithms 


We give the following technical lemma, which is also known as the “Smith 
Rule” in the area of scheduling. 


Lemma 1 Given p,,...,Pn > 0, W1,.--,Wn > 0 with on = a +. 2 22 and 
permutation tm. Fori =1,...,n let P™ = = Pr(j). Then fr = yy PP WG) 


is minimized when m is the identity. 


Proof: Consider permutation 7, which is not the identity. Then 7 has an 
inversion j > 7 with i immediately before j in r. Let 7’ be the permutation 
with i and 7 interchanged. We have 


fo—fe = pw t (pit pw; — pw; — (Dit Dj) wi 
= PiWj — Pjwi 
< 0, 


since = > a It follows that f, < f, and we are done. 
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Figure 4: PSEUDOBATCH for p, = 0.2,p2 = 0.6,p3 = 0.2,p4 = 0.3, p5 = 
0.1,p¢ = 1.1. 


Lemma 2 Let C; be the completion times of an optimal schedule for the 
1|s-batch| )> wiC; problem and let P; = ee pj. Then we have 


n n 
So wiC; = So wil P, +1) 
i=1 i=1 
Proof: Let permutation o be the order of the optimal schedule. Then 
Py +1< Cj. 


Due to Lemma 1 we have 


n n n 
So wil; = S > wi( PP ++ 1) > So wi(P; + iy: 
1=1 4=1 4=1 


We now present a simple, parameterized algorithm, PSEUDOBATCH, 
for the 1|s-batch| }> w;C; problem. PSEUDOBATCH first reorders the jobs 
so that they are in canonical order. Then jobs are assigned to batches in 
that order. After receiving J;, our algorithm has only two choices, namely 
whether to assign J; to the same batch as J;_1 or not. We use the phrase 
“A batches at step 7” to mean that algorithm A decides that J; is the first 
job of a new batch, i.e. m; = mj_1 +1. We use the phrase “current batch” 
to denote the batch to which the last job was assigned. Then, when J; is 
received, A must decide whether to add J; to the current batch, or “close” 
the current batch and assign J; to a new batch. PSEUDOBATCH maintains 
a variable P which will be the sum of the processing times of a set of recent 
jobs: we call this set the current pseudobatch. When J; is received, P is 
set to 0. After receiving each subsequent J;, PSEUDOBATCH first adds p; 
to P. If P > 1, PSEUDOBATCH batches and also sets P to zero. Thus, the 
it pseudo-batch contains all but the first member of the i“” batch, together 
with the first member of the (i +1)** batch, unless i = r. Every job except 
J; belongs to just one pseudo-batch. 


Figure 4 gives an example for py = 0.2, po = 0.6, pg = 0.2, p4 = 0.3, ps = 
0.1 and pg = 1.1. 


Theorem 1 PSEUDOBATCH has an approximation ratio of 2. 


Proof: As before let C; be the completion times of an optimal schedule 
for the 1|s-batch| }*> w;C; problem. Let C;, denote the completion times of 
the jobs when algorithm PSEUDOBATCH is run on the instance and let m; 
be the number of batches created by the algorithm. Clearly we have 


C.< Pt+m4+1 


and 
(m; ec 1) < P.. 


Thus, ; 
Ci; < 2P; + 2. 


By Lemma 2 we have 


n n 
So wil; < 25° wi(P? ++ 1) 
4=1 4=1 


2 5 wC;. 
i=l 
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Let CANONICALBEST be the algorithm which puts the jobs in canonical 
order and the linear time algorithm of the next section (or the algorithm 
of [1]) to get the optimal list batching schedule under the canonical order. 
Clearly we have: 


Theorem 2 CANONICALBEST has an approximation ratio of 2. 


Proof: Algorithm PSEUDOBATCH has approximation ratio of 2 and isa 
priority algorithm. Given an instance of the problem, algorithm CANONI- 
CALBEST produces a schedule with weighted average completion no worse 
than algorithm PSEUDOBATCH. 
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Figure 5: Reduction of the List Batching Problem to a Path Problem. 


3 An Alternate Linear Algorithm for List Batch- 
ing 


We now turn to the run time of Algorithm CANONICALBEST. As mentioned 
earlier, Brucker and Albers [1] gave a linear time algorithm for the list 
batching problem. We give here a simple alternate algorithm here. The 
algorithm is similar to their algorithm but it utilizes, as a subroutine, the 
well-known linear time matrix searching algorithm of Larmore and Schieber 
[15]. 

To this end let us assume that the jobs are 1,..., and are given in this 
order. One can then reduce the list batching problem to a shortest path 
problem in the following manner: Construct a weighted directed acyclic 
graph G with nodes i = 1,...,n (i.e. one node for each job) and add 
a dummy node 0. There is an edge (i,j) iff i < 7. (See Figure 5 for a 
schematic.) Let edge costs ¢,; for i < j be defined as 


n j 
Cig = ( S- we)(s + >" pe); (1) 


é=i4+1 l=1 


where s = 1 is the batch setup time. We briefly note: 


Lemma 3 The matrix C = (qj) defined in (1) is Monge for all choices 
of pi, w; > 0. Furthermore values can be queried in O(1) time after linear 
preprocessing. 


Proof: Let W; = yy wy and P; = ce py be the partial sum of the 
p; and w; values. Then we have 


elt, Jj] = cj = (Wn — Wi)(s + Pi) 


For i < 7’ and j < 7’ 


eli, J] i ely | = cli’, J] a cli, 7] 
= (Pj — Pj) (We — Wi) 
= 0. 


Returning now to the discussion of the reduction, it is easily seen (see 
[1] for details) that the cost of path < 0,71, %2,...,ip,n > gives the )> Cyw; 
value of the schedule which batches at each job 71,%2,...,7,%. Conversely, 
any batching with cost A corresponds to a path in G with path length A. 

A shortest path can be computed in time O(n”) using the following 
dynamic program: 


Let 
E|é| = cost of the shortest path from 0 to Z, 
then 
Elé) = min {E[k] + c,.} with £[0] = 0, (2) 
1<k<e 


which results in a table, in which elements can be computed row by row 
(see Figure 6.) 

In other words, the dynamic program computes the row minima of the 
(n — 1) x (n—1) matrix E, where 


Elk] + clk, 4 if£<k 
oo else 


EItA = { (3) 
with @= 2,...nandk=0,...,n—1. 


Lemma 4 The matrix E = (E¢;,) defined in (3) is Monge. 
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Figure 6: Dynamic Programming Tableau. 


Proof: Monge is preserved under addition and taking the minimum. 

As it turns out all row minima can be computed in linear time using 
the algorithm of Larmore and Schieber, which is also known as the LARSCH 
algorithm [15]. To execute the LARSCH algorithm we need only that the 
matrix E satisfy the following conditions: 


1. For each row index @ of E, there is a column index 7 such that for 
k> ve, Een = 0. Furthermore, ye < Ye41. 


2. Ifk < ye, then E[é, k] can be evaluated in O(1) time provided that the 
row minima of the first € rows are already known. 


3. EF is a totally monotone matrix. 


If these conditions are satisfied, the LARSCH algorithm then calculates 
all of the row minima of E in O(n) time. (See also [5]). 

Condition 1 is clear from the fact that in matrix F all infinities are in 
the upper triangle of the matrix. 

We turn to Condition 2. Condition 2 describes the online protocol 
underlying the computation of the dynamic programming tableau. It states 
that an element in column k is “knowable” once the row minimum of row 
k is revealed. Figure 7 illustrates this. For example, once the minimum of 
row 4 (that is, the value for E|4]) is known then the values of column 4 are 
available, since these values are of the form E[4] +c[.,.]. Furthermore, these 
values can be queried in O(1) time due to Lemma 3. 

Condition 3 follows from Lemma 4. 
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Figure 7: The “Online” Protocol of the Tableau. 


Since CANONICALBEST requires the priorities to be sorted first, in sum- 
mary we have: 


Theorem 3 Algorithm CANONICALBEST has run time O(nlogn). 


4 A Lower Bound for Priority Algorithms 
We now give a lower bound of 76 s 1.1124 on the approximation ratio of 
any priority algorithm. To show the lower bound, consider a problem which 
consists of exactly two jobs. There are two orders of the jobs possible. 
With each order there are two ways to batch the problem; either a single 
batch consisting of both items or two single batches, each containing one 
of the items. Since the order of jobs within a batch is irrelevant, two of 
the possibilities are identical and thus a total of three possibilities exist for 
OPTIMUM, and CANONICALBEST. 

Given now a problem {(pj, w1), (p2, w2)} we assuming equal priorities 


ot = pe = 1 it can be shown that {(pi, 1), (p2, w2)} = {(1,1+ 6), (1+ 
V6,1+ V6)} maximizes C = fan . We note the value e, is used to break the 
tie and force CaNoNIcALBEST: ‘to choose an order different than OPTIMUM; 


however, € will tend to 0. 
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We use square brackets | ] to denote a batch. Now consider: 


[{(1,1 +), (1 + V6,1+ V6)}] (4) 
C = (1 ets p2)(w) + we) 
= (l+l+e+1+4v6)(1+1+ V6) 
Se eae 
~ 24.25 


{(1,1+ )}[{( + v6, 1+ v6)} (5) 
1+pi)wi + (2+ p1 + p2)we 

e)l1+(2+14+1+4+ V6)(1+ V6) 
2+6¢)+(4+ V6)(14+ V6) 


l 
SS AS IS 
— 
+ 
— 


[{(1+ v6,1+ V6)}[{G,1+ 9} (6) 
1+ po)w2 + (2+ po + pi)wi 

141+ V6)(1+ V6) + 

2+14+V6+1)(1+6) 

= + V6)(1+ V6) + (44+ V6)(1 +6) 

~ 21.80 


( 
( 
( 
(24 


OPTIMUM chooses order (6) as it gives lowest cost possible. CANONI- 
CALBEST is forced to choose between (4) or (5) due to the slight increase of 
the priorities of (1, 1+), caused by ¢, ordering that job first. Both choices 
have the same cost. Thus: 


Cea m 


Ce 
~ Copt 


(34+ V6+.6)(2+ V6) 
(2+ V6)(1+ V6) + (44+ V6)(1 +6) 


As ¢€ tends to 0, we have 


M 
m 
-—t 
K 
i) 
oe 


5 Adaptive Algorithm Experiments 


In the previous section we have exhibited a solution which gives the worst 
approximation ratio for CANONICALBEST when there are two jobs. The 
question remains whether a more difficult problem exists considering a larger 
number of jobs. We conjecture that this is not the case. In this section we 
will give results of computer experimentation that support this conjecture. 

To explore problem spaces consisting of more than two jobs an evolu- 
tionary algorithm was developed. Individuals consisted of a single problem 
with an arbitrary number of jobs 7, where 2 < i < 6. Jobs were limited 
to six because the optimal solution was obtained by exhaustive search. For 
an individual, the number of jobs and the job data represent the genetic 
makeup of that individual. The fitness function f(a) used to evaluate the 
suitability of individual x for inclusion in successive evolutions is simply the 
CANONICALBEST competitive ratio of the individual’s problem. 

The algorithm is seeded with a single individual consisting of at least 
one job. Any individual with a single job will always have f(x) = 1.0; 
mutation is used to quickly produce individuals with two or more genes 
with f(x) > 1.0. The evolutionary environment sustains a total of ps = 50 
parents. Using a simple deterministic selection process, all pairs of parents 
were mated to produce \ = pz? = 2500 offspring. Of the resulting population 
of uw + A = 2550, the strongest 50 were retained for the next generation. 

In evolutionary algorithms, offspring are typically the product of mu- 
tation and crossover of their parents; however in our search we only relied 
on mutations. Mutations of a parent consisted of processing the parent’s 
jobs (genes); any single job had a probability of }n.4 = 0.1 of producing 
a mutation; otherwise it was simply copied to the child. Several types of 
mutations were applied. Mutations affected either the weight or processing 
time of a job. 


e With probability 0.25 values could be scaled by a random amount 
with the intention of introducing random variability thereby landing 
on new neighborhoods of the landscape. 


e Values could double (probability 0.25) or values could be halved (prob- 
ability 0.25) in order to quickly converge on instances that relied on 
small or large values of a particular job in relation to others. 


e With probability 0.25 values could also change by small amounts for 
the case that a job could be made harder by very small tweaks to the 
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Gen f(x) | Problem 
49 1.109481 | {(1.01, 0.40), (3.20, 1.26)} 
144 | 1.109964 | {(1.01,0.40), (3.20, 1.26)} 
284 | 1.111070 | {(0.99, 0.39), (3.20, 1.26)} 
1969 | 1.111199 | {(0.99, 0.39), (3.20, 1.26)} 
5705 | 1.111338 | {(0.99, 0.39), (3.20, 1.26)} 
9283 | 1.111842 | {(1.00, 0.40), (3.20, 1.26)} 
{( ),( )} 
{( ),( )} 
{( ),( )} 
( ( 


10487 | 1.111890 1.00, 0.40), (3.20, 1.26 
10971 | 1.111920 1.00, 0.40), (3.20, 1.26 
17910 | 1.111956 1.00, 0.40), (3.20, 1.26 
26522 | 1.111957 | {(1.00, 0.40), (3.20, 1.26) } 


Table 1: Improvements During Random Seeded Case. 


current design. (This is a bit similar to use of € in Section 4). 


Finally, with probability 0.1 we applied an additional change to the 
child, where the number of jobs was changed with probability 0.5 to increase 
and with probability 0.5 to decrease by one job. Decreases were performed 
by the deletion of a random job with equal probability. Addition of a job 
was introduced by either adding a random job, or by duplicating one of the 
already present jobs with equal probability. Change was avoided if it would 
produce job sizes outside of the allowable range. 

When the algorithm is seeded with {(1.0,1.0)} the resulting evolution 
was uninteresting. At generation 5 an individual was arrived at consist- 
ing of {(1.00, 1.00), (4.00, 4.00)}, where f(x) = 1.1111. From this time up 
until at least generation 18813, consisted of 50 clones of this individ- 
ual and appeared to remain stable despite the existence of a known, more 
difficult problem (Section 4). Similarly, when seeded with that problem, 
{ (3.45, 3.45), (1.00, 1.00)} , immediately converged on 50 clones of this 
individual, with no variation at all, up until at least generation 20553. No 
other, more difficult, problem is found. 

When seeded with a random job of { (0.33, 0.54)} things were a bit more 
interesting. The early generations showed a more diverse p consisting of six 
unique individuals; all with f(x) = 1.0. In generation 49 the individual of 
{(1.01, 0.40), (3.20, 1.26)} was found with f(x) = 1.109481 and wp consisted 
of 50 copies. Later generations showed further small improvements. A 
sampling of that evolution is illustrated in Table 1. 
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Parent 1 | 184 637,25 random slice 637 
YY 


Parent 2 | 352718|64 add underlined 
Child 218637|45 child is a valid permutation 


Figure 8: Example of an Ordered Crossover. 


All the improvements appear to be the result of the small tweaks mu- 
tations, other mutations failing to produce competitive individuals. No 
further improvement was found as of generation 72233. 

We now turn to an unrelated implementation under GAlib, the object- 
oriented library of Matthew Wall [19] developed at MIT. Because it is pos- 
sible to give an optimal schedule in linear time if the order is fixed (as 
described in Section 3) in the 1|s-batch| 5) w;C;, it is natural to consider a 
genetic algorithm where the search space is the set of permutations. Then 
each individual’s fitness — its weighted average completion — can be evalu- 
ated in linear time. 

We have to define mutation and crossover. A mutation simply swaps 
two arbitrary elements of the permutation. For the crossover it is impor- 
tant to devise a mechanism that retains some features of the original two 
individuals in such a meaningful way that results in two new permutations. 
In the ordered crossover first used by Prins (see [17]), one takes a random 
subsequence of the first parent’s permutation and insert it directly into 
the child. As described in Figure 8, the child is then completed by taking 
material from the second second parent’s permutation, where elements are 
inserted into the child in the order they occur in that parent, starting after 
the second cut location, and ignoring elements already inserted from the 
first parent. 

All experiments had the following parameters in common: 


e Population Size: 1000 


e Number of Generations: 5000 


Number of jobs: 100 
e Crossover probability: 0.85 


e Mutation probability: 0.005 
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The results were compared with the (conservative) lower bound of 
Lemma 2 and our results consistently gave solutions within a ratio of p = 
1.59. The detailed results of these experiments are in [18]. 


6 Conclusions 


We have given a priority approximation algorithm for the 1|s-batch]| > w;C; 
problem. We have also shown that no priority algorithm can have approx- 
imation ratio less than zs, As we have pointed out, we conjecture that 
algorithm CANONICALBEST matches this lower bound. However, it is an 
interesting open research problem to prove the correctness of this conjecture. 

Note that the lower bound of 726 holds only for priority algorithms. 
It is current research to investigate if there is a lower bound even if this 
assumption is dropped, or to give a polynomial approximation scheme in 
case such a lower bound does not exist. 

We note that a version of the algorithm PSEUDOBATCH is useful for 
online batching problems and we given results for the online case in [4]. 
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